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ABSTRACT 



An apparatus for producing pseudo-stereophonic sound 
from a monaural signal including a monaural source 
having a first speaker disposed in an anechoic room and 
having a sound output generated by the monaural sig- 
nal. Second, third, fourth and fifth speaker disposed in 
the anechoic room (substantially) symmetrically about a 
listener having two ears. The monaural signal from the 
source is processed to output processed signals to each 
of the second, third, fourth and fifth speakers, each 
speaker producing a sound output corresponding to the 
received processed signal. A pair of microphones are 
disposed in the ears of the listener for receiving the 
sound outputs of the first, second, third, fourth and fifth 
speakers and producing two differentiated audio chan- 
nels. 

12 Claims, 5 Drawing Sheets 
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HEAD RELATED TRANSFER FUNCTION 
PSEUDO-STEREOPHONY 

ORIGIN OF THE INVENTION 5 

The invention described herein was made in the per- 
formance of work under a NASA contract and is sub- 
ject to Public Law 96-517 (35 U.S.C. 200 et seq.). The 
contractor has assigned his rights thereunder to the 
Government. 

BACKGROUND OF THE INVENTION 

1. Technical Field of the Invention 

The present invention relates generally to the field of 
stereophony and, more specifically, to a head related 
transfer function pseudo-stereophony in which two 
differentiated audio channels are derived from a single 
channel. 

2. Description of the Prior Art ^ 
"Pseudo-stereophony" is a generic description of a 

family of techniques that allow the derivation of two 
channels of sound from a monaurally-recorded, one 
channel source. Signal processing techniques for 
achieving pseudo-stereophony have existed for at least 2 < 
thirty-six years, a time period roughly paralleling the 
commercial introduction of home stereo systems. In 
general, these techniques all involve a process where 
the two channels of output are derived according to a 
decorrelation process, i.e., the monaural input is pro- 30 
cessed to each channel in a differential manner so as to 
create two non-coherent signals. One technique, known 
as differential filtering, uses a high-pass filter for output 
channel one and a low-pass filter for output channel 
two. Other differential filtering techniques have used 35 
two comb filters with complimentary frequency re- 
sponses, or two all-pass filters with differential phase 
response. 

Another type of pseudo-stereophony can be referred 
to as reverberation and time delay techniques where, 40 
for example, the technique involves adding differen- 
tially time delayed, scaled versions of the signal to each 
output channel, with the possibility of adding recircu- 
lated sound. 

Yet another type of pseudo-stereophony involves 45 
differential sub-audio frequency modulation of the out- 
put channels. This is sometimes called "pitch shifting". 

The aforementioned techniques suffer from one or 
more drawbacks, including the overt "coloration" of 
the sounds timbre in each separate channel of the out- 50 
put. Also, with loudspeaker reproduction the listener is 
required to sit near the center of the speakers. Further, 
there is a general inability to mix the pseudo-stereo 
output to monaural without disturbing the timbral dis- 
tortions. Also, with stereo reverberation techniques, the 55 
problem of additional reverberation time is appreciable. 
The sound becomes "muddy" (overly reverberant) as a 
result of convolving an originally reverberant signal 
with the reverberation of the signal processor (and 
eventually that of the listening space). 60 

The pinnae of the human ears are shaped to provide 
a transfer function for received audio signals and thus 
have a characteristic frequency and phase response for 
a given angle of incidence of a source to a listener. This 
characteristic response is convolved with sound that 65 
enters the ear and contributes substantially to our ability 
to listen spatially. This is known as the "head related 
transfer function" (HRTF). The HRTF was described 
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by Jens Blauret in "The Psychophysics of Human 
Sound Localization", MIT Press, Cambridge, 1983. 

HRTFs have been mentioned in some U.S. patents. 
For. example, U.S. Pat. No. 4,388,494, issued to Schone 
et al describes a pseudo-stereophonic reproduction cir- 
cuit utilizing HRTFs. Similarly, U.S. Pat. No. 
4,359,605, issued to Haramoto et al describes pseudo- 
stereophonic signal generation utilizing HRTFs. 

U.S. Pat. No. 4,219,696, issued to Kooure et al, dis- 
closes stereo signal generation having localized sound 
images dependent on HRTFs. U.S. Pat. No. 4,192,969 
discloses HRTF-related stereophonic signal generation 
with gauged adjustable attenuators for variable fre- 
quency correlation and response. 

A continuing need exists for improved pseudo-stereo- 
phonic signal generation capable of producing two 
channel sound derived from a monaural source. 

SUMMARY OF THE INVENTION 

An object of the present invention is to derive two 
differentiated audio channels from a single channel 
based on the head related transfer function. 

Another object of the present invention is to provide 
a method and apparatus for producing pseudo-stereo- 
phony which avoids coloration of the sound timbre in 
each separate channel of a two channel output derived 
from a single channel source. 

Another object of the present invention is to provide 
a method and apparatus for producing pseudo-stereo- 
phony in which the listener is not required to be posi- 
tioned in the center of two speakers. 

Yet another object of the present invention is to pro- 
vide a method and apparatus for producing pseudo- 
stereophonic output channels which can be mixed to 
monaural (one channel) without disturbing coloration 
effects that result from phase cancellation. 

Still another object of the present invention is to 
provide a method and apparatus for producing pseudo- 
stereophony in which the sound image has an increased 
dimension of spaciousness. 

These and other objects of the present invention are 
met by providing an apparatus for producing pseudo- 
stereophonic sound from a monaural signal. The appa- 
ratus is based on the concept of a monaural source hav- 
ing a first speaker disposed in an anechoic room, the 
first speaker having a sound output based on the monau- 
ral signal, a second, third, fourth and fifth speaker dis- 
posed in the anechoic room substantially symmetrically 
about a listener having two ears, signal processing 
means for receiving the monaural signal from the source 
and outputting processed signals to each of the second, 
third, fourth and fifth speakers, each speaker producing 
a sound output corresponding to the received processed 
signals, and a pair of microphones, one disposed in each 
ear of a listener for receiving the sound outputs of the 
first through fifth speakers and producing two differen- 
tiated audio channels. Preferably, the signal processing 
means includes a gain unit which increases the monaural 
signal to the second, third, fourth and fifth speakers, and 
four variable delay units, one corresponding to each of 
the second, third, fourth and fifth speakers. 

In another aspect of the present invention, a method 
for producing pseudo-stereophonic sound from a mon- 
aural signal includes the steps of feeding a monaural 
input signal to an A/D converter to produce a digitized 
output signal, distributing the digitized output signal 
across six lines to produce six digital output signals, 
passing two of the six output signals respectively to left 
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and right summation devices, passing each of the re- is obtained from the output of the two microphones, 
maining four output signals through individual delay which can be delivered to a left channel speaker 42 and 
devices to establish four different delayed signals, multi- a right channel speaker 44 which produce pseudo- 
plying each of the four different delayed signals by a stereophonic sound for a listener 46. 
common value, filtering each of the four multiplied 5 Microphones are placed inside of the ears of the lis- 
signals through FIR filters having an impulse frequency tener to capture the characteristic frequency and phase 
response matching ipsilateral and contralateral magni- response for a given angle of incidence from a source to 
tude responses of the head related transfer functions of a listener. This characteristic response is convolved 
an average listener and a linear phase response to pro- with sound that enters the ear and contributes substan- 
duce left and right channel output signals, summing the 10 tially to our ability to listen spatially. This is known as 
left channel output signals with the unprocessed digital the "head related transfer function" (HRTF), as de- 
signal in the left summation device, summing the right scribed in the aforementioned article by Jens Blauret in 
channel output signals with the unprocessed digital his article "Spatial Hearing: The Phytophysics of 
signal in the right summation device, and converting Human Sound Localization" MIT Press, Cambridge, 
the summed signals in a D/A converter to produce 15 1983, this article being incorporated herein by refer- 
analog left and right channel signals. ence. 

These and other features and advantages of the It is possible to simulate the characteristic frequency 

method and apparatus for producing pseudo-stereo- and phase response described above by means of digital 

phonic sound according to the present invention will filtering according to the present invention. An efiec- 

become more apparent with reference to the following 20 tive simulation of the spatial dimensions of sound can be 

detailed description and drawings. achieved by using filters whose impulse response and 

BRIEF DESCRIPTION OF THE DRAWINGS ^^S^^^SttS^^ 

FIG. 1 is a schematic view of a first embodiment of ers, spatial effects can also be obtained with HRTF 
the present invention; 25 filtering that are impossible to accomplish with other 

FIG. 2 is a schematic diagram of the present inven- methods. This includes the ability to move the virtual 
tion showing signal processing corresponding to the sound image beyond the arc defined by stereo loud- 
embodiment of FIG. 1; speakers (so long as each ear is receiving a suitable 

FIG. 3 is a more detailed schematic view of each of amount of signal from each speaker), 
the eight HRTF filter networks of FIG. 2; 30 Referring now to FIG. 2, a signal processing arrange- 

FIG. 4 shows the frequency response for filters based ment according to the present invention mimics the 
on the free-field HRTF for positions at 0 degrees eleva- heuristic description of the invention shown in FIG. 1. 
tion, and at 90, 120, 240 and 270 degrees azimuth; The monaural input signal is fed to an analog to digital 

FIG. 5 shows the group delay response for filters (A/D) converter 48, typically having a 44. 1 kHz sam- 
based on the free-field HRTF for positions at 0 degrees 35 pling rate and 16 bit word length. The digitized signal is 
elevation, and at 90, 120, 240 and 270 degrees azimuth; then distributed across six lines, numbered 1-6 in FIG. 

FIG. 6 shows the frequency response for filters based 2. Lines 1 and 6 pass their signal directly to left and 
on the monaural HRTF for positions at 0 degrees eleva- right digital summation devices 50 and 52, while lines 2, 
tion, and at 90, 120, 240 and 270 degrees azimuth; 3, 4 and 5 each pass through an individual digital delay 

FIG. 7 shows the group delay response for filters 40 device 54, 56, 58 and 60. These are either set to fixed 
based on the monaural HRTF for positions at 0 degrees values or are interactively set by the user as further 
elevation, and at 90, 12, 240 and 270 degrees azimuth; described below. The value of time delay used for lines 

FIG. 8 is a schematic view showing angle of inci- 2, 3, 4 and 5 are all different, as will also be described in 
dence and sequence of delays according to the present. more detail below. 

invention. 45 The output of each delay device 54, 56, 58 and 60 is 

passed through an individual digital multiply device or 
gain devices 62, 64, 66, and 68. The value added to each 
signal by the gain devices is identical and are nominally 
Referring now to FIG. 1, a pseudo-stereophony ap- set to a value whereby the signal of lines 2, 3, 4 and 5 are 
paratus is generally referred to by the numeral 10 and 50 each increased by for example, six dB above the ampli- 
includes a monaural sound source 12 having an associ- tude level of lines 1 and 6. The value of the multiply can 
ated speaker 14. The speaker is driven by a sound signal be adjusted by the user. 

produced by the source 12 to thereby generate audible The output of each gain device 62, 64, 66 and 68 is fed 
sound waves. The speaker 14 is positioned in an an- through a separate HRTF filter network 70, 72, 74, and 
echoic chamber 16, such as a sound-proof room, di- 55 76. As shown in FIG. 3, each HRTF filter network 
recti y in front of a listener 18 having a pair of ears. Four includes two FIR (Finite Impulse Response) filters 78 
additional speakers 20, 22, 24 and 26 are placed at ear and 80 whose impulse frequency response matches the 
level around the listener 18 at 90°, 120% 240° and 270' ipsilateral HRTFs of an average listener at 90, 120, 240 
azimuth, respectively. These four additional speakers and 270 degrees azimuth, 0 degrees elevation. Each 
receive a processed version of the signal emitted from 60 HRTF filter network takes a single input and derives 
the monaural speaker 14. The loudness of the signal is two differentiated outputs, one for each output channel, 
first boosted by a gain unit 28 and then is fed in parallel using the two separate FIR filters 78, 80 shown in FIG. 
to four individual variable delay units 30, 32, 34 and 36, 3. The FIR filter 78 for the left output summed at 50 in 
each serving one of the four speakers 20, 22, 24 and 26. FIG. 3 uses a particular frequency and group delay 
Two probe microphones 38 and 40 are placed inside 65 response for a particular angle of incidence, as shown in 
the ears of a listener whose pinnae match the average FIGS. 4 and 5, or alternatively in FIGS. 6 and 7. The 
shape and transfer function of an average listener. The FIR filter 80 for the right output summed at 52 in FIG. 
two channel signal for the pseudo-stereophonic output 3 uses the frequency and group delay responses shown 



DETAILED DESCRIPTION OF THE 
INVENTION 



07/30/2004, EAST Version: 1.4.1 



5,173; 

in FIGS. 4 and 5, or alternatively in FIGS. 6 and 7, of 
the symmetrically opposed angle of incidence of the 
HRTF measurement used in FIR filter 78. Specifically, 
referring to FIG. 2. HRTF filter network 70 uses an 
HRTF measurement for 90 degrees for FIR filter 78 5 
and 270 degrees for FIR filter 80-HRTF filter network 
72 uses an HRTF measurement for 120 degrees for FIR 
filter 78 and 240 degrees for FIR filter 80-HRTF filter 
network 74 uses an HRTF measurement for 240 degrees 
for FIR filter 78 and 120 degrees for FIR filter 80; and 10 
HRTF filter network 76 uses an HRTF measurement 
for 270 degrees for FIR filter 78 and 90 degrees for FIR 
filter 80. 

The left output channel of each of the four HRTF 
filtering networks are summed by the digital summation 15 
device 50, along with the unprocessed output of the 
A/D converter from line 1, while the right output chan- 
nel of each of the four HRTFs filter networks is 
summed by the digital summation device 52, along with 
the unprocessed output of the A/D converter from line 20 
6. The summed output for the left and right channels are 
then passed through separate digital to analog (D/A) 
converters 82 and 84. 

The parameters of each part of the circuit illustrated 
in FIG. 2, such as time delays, gains, and HRTF filters, 25 
are designed in order to meet specific psychoacoustic 
criteria described below. 

The overall gain of the four delayed sounds are made 
louder than the direct sound through the use of the 
digital multiply or gain devices 62, 64, 66 and 68. Each 30 
of the four delayed sounds is boosted by six dB, This 
was determined empirically as the best value for achiev- 
ing the pseudo-stereophonic effect with a range of dif- 
ferent sound materials, such as speech and music. This 
multiply could also be set by the user via knob setting so 35 
that at a minimum setting, the pseudo-stereophony 
would be effectively by-passed and at a maximum set- 
ting, of about 12dB, an exaggerated effect could be 
produced. For systems not allowing operator interac- 
tion, about 6dB would be the optimal fixed value. 40 

With respect to setting the time delays, each delay 
arrives at the loudspeakers differentially in time. The 
following temporal dimensions were taken into account 
for the setting of each value of delay: (1) the initial time 
gap between the undelayed sound and the first delay; (2) 45 
the time between each successive delay; and (3) the time 
of the final delay, which is a function of the first two 
parameters. An important psychoacoustic consideration 
is that the signals remain below the level of echo distur- 
bance. Thus, the initial time delay gap, rather than the 50 
timing of the final delay, was found to be crucial in this 
regard. The acceptable time delay is also a function of 
the gain of the delay. For the gains used herein, a range 
of between 15 and 25 milliseconds (ms) was found useful 
for the initial time delay gap. 55 

The duration between each successive delay was 
selected to be within a range so that each delay would 
not be heard as a separate sound. For the circuit de- 
scribed herein, a range of 5 to 10 ms between each 
successive delay was found to be ideal. 60 

In order for head related transfer function to create a 
sensation of increased auditory spaciousness, 30 ms was 
determined as the minimum value for the timing of the 
final delay. This is in line with research into the effect of 
early reflections in concert halls. 65 

Based on these considerations, four sets of time delays 
were determined for minimum and maximum of delay 
produced by the delay devices 54, 56, 58 and 60: 
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25 
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25 


35 


45 


55 



The first sets A and B use a 15 ms initial time delay, 
and sets C and D use a 25 ms time delay. Intermediate 
values could also be used, depending on the effect de- 
sired. For creating an effective sensation of stereo, A 
and B work better for speech but not as well for music 
as do C and D. This is because the threshold for echo 
disturbance for music is higher than compared to 
speech. A user interface would allow setting the initial 
time gap with a knob between 15 and 25 ms and the gap 
between successive reflections between 5 and 10 ms. 

There are three considerations in the implementation 
of the HRTF filters used: the angle of incidence synthe- 
sized for the particular delay; the sequence of arrival; 
and the phase and frequency response to the filters. The 
angles of incidence used are illustrated in FIG. 8. These 
angles are based on measurements made at 0° elevation 
("ear level"). These angles are chosen because of sym- 
metry (90-270 and 240-120), location to the sides (to 
produce a stereo effect, filters measured at the locations 
of a virtual stereo speaker produces the best results), 
and the angles are maximally incoherent with regard to 
the unfiltered monaural source. The sequence is ar- 
ranged so the sound delays alternate twice from left, 
then right. This is done so as not to weight the sound 
image towards one particular side. 

The FIR filters used according to the present inven- 
tion are created with a filter design program, based on 
an algorithm described by McClellan, Parks and Rab- 
iner in their article "FIR Linear Phase Filter Design 
Program" (in Programs for Digital Signal Processing 
(1979; New York, IEEE Press)). This is a commonly 
used algorithm available in several filter design soft- 
ware packages. Each filter uses a 75 tap symmetrical 
arrangement of coefficients, resulting in a linear phase 
response. Linear phase filters are desirable in that they 
do not distort the time response of the waveform. If all 
filters used are of linear phase, as with the HRTF filter 
network of the present invention, then there is no 
chance of the combining of the output signals in such a 
way that their time responses interact constructively or 
non-constructively. 

The pseudo-stereophony effect of the present inven- 
tion can be implemented into hardware using off-the- 
shelf integrated circuit chips, such as a Motorola 56001 
DSP chip. All of the processing described with respect 
to FIG. 2 can be accomplished with these or equivalent 
DSP chips. 

In the aforementioned embodiment of pseudo-stereo- 
phony, only four HRTF filter networks were used. 
However, a larger number of delay-gain-HRTF filter 
networks could be added in an alternative embodiment. 
Fewer or greater number of coefficients used to repre- 
sent the HRTFs used in FIR filters 78 and 80 could also 
be part of an alternative embodiment. 

Other embodiments of the invention may or may not 
provide a user interface for gain level and time delays, 
as mentioned above. 

The results of the present invention provide advan- 
tages over the prior art. For example, the signal, from 
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each channel sounds less "colored" (i.e., timbrally al- 
tered) than with previous methods. Also, a pseudo- 
stereo image can be had from a wide range of listening 
positions, as a result of the complex frequency response 
interaction of the filters. Previous methods require a 5 
more fixed listening position. The two output channels 
of the present invention can also be mixed to monaural 
(one channel) without disturbing coloration effects that 
result from phase cancellation. Moreover, the sound 
image has an increased dimension of spaciousness. This 
results from the resultant decorrelation of the two out- 
put signals. The present invention also allows multiple 
inputs with differential frequency responses to be more 
easily distinguished from one another, compared to 
monaural listening. 

Numerous modifications and adaptations of the pres- 15 
ent invention will be apparent to those so skilled in the 
art and thus, it is intended by the following claims to 
cover all such modifications and adaptations which fall 
within the true spirit and scope of the invention. 

I claim: 20 

1. An apparatus for producing pseudo-stereophonic 
sound from a monaural signal comprising: 

a monaural source having a first speaker disposed in 
an anechoic room and having a sound output gen- 
erated by the monaural signal; 25 

a second, third, fourth and fifth speaker disposed in 
the anechoic room substantially symmetrically 
about a listener having two ears; 

signal processing means for receiving the monaural 
signal from the source and output ting processed 3Q 
signals to each of the second, third, fourth and fifth 
speakers, each speaker producing a sound output 
corresponding to the received processed signal; 
and 

a pair of microphones, one disposed in each ear of the 
listener for receiving the sound outputs of the first, 
second, third, fourth and fifth speakers and produc- 
ing two differentiated audio channels. 

2. An apparatus according to claim 1, wherein the 
signal processing means includes a gain unit which in- 
creases the monaural signal and four variable delay W 
units, one corresponding to each of the second, third, 
fourth and fifth speakers. 

3. An apparatus according to claim 2, wherein the 
second, third, fourth and fifth speakers are disposed, at 
90', 120*, 240* and 270* azimuth, respectively. 45 

4. An apparatus according to claim 2, wherein the 
gain unit increases the monaural signal delivered to 
each of the second, third, fourth and fifth speakers by 
about 6dB. 

5. An apparatus for producing pseudo-stereophonic 50 
sound from a monaural signal comprising: 

an A/D converter for receiving the monaural signal 
and producing a digitized output signal; 

means for distributing the digitized output signal 
across six lines to produce six digital signals; 5J 

a left and a right summation device, each receiving 
one of the six digital signals; 

four delay devices, each receiving one of the four 
remaining digital signals and outputting four differ- 
ent delayed signals; 

multiplier means for multiplying the four different 60 
delayed signals by a common value; 

filtering means for filtering each of the four multi- 
plied signals to produce left and right output chan- 
nel signals; 

the left output channel signals being delivered to the 65 
left summation device and being summed with the 
unprocessed digital signal delivered thereto, and 
the right output channel signals being summed in 
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the right summation device with the unprocessed 
digital signal delivered thereto; 
a D/A converter receiving the summed left and right 
output channel signals and outputting two differen- 
tiated audio channels. 

6. An apparatus according to claim 5, wherein the 
filtering means includes four filter networks, each asso- 
ciated with one of the prior delayed signals, wherein 
each filter network includes two FIR filters having an 
impulse frequency response matching ipsilateral and 
contralateral head related transfer functions of an aver- 
age listener and a linear phase response, each of the two 
FIR filters producing one of the left and right output 
channel signals. 

7. A method of producing a pseudo-stereophonic 
sound from a monaural signal comprising the steps of: 

feeding a monaural input signal to an A/D converter 

to produce a digitized output signal; 
distributing the digitized output signal across six lines 

to produce six digital signals; 
passing a first of the six signals to a left summation 

device; 

passing a second of the six signals to a right summa- 
tion device; 

passing each of the remaining four signals through 
individual delay devices to establish four different 
delay signals; 

outputting the four different delay signals by a com- 
mon value; 

filtering each of the four applied signals through FIR 
filters having an impulse frequency response 
matching ipsilateral and contralateral head related 
transfer functions of an average listener and a linear 
phase response to produce left and right output 
channel signals; 

summing the left output channel signals with the first 
unprocessed digital signal in the left summation 
device; 

summing the right output signals with the second 
unprocessed digital signal in the right summation 
device; and 

converting the summed left and right output channel 
signals in a D/A converter to produce analog left 
and right output channel signals. 

8. A method according to claim 7, wherein the four 
different delayed signals are multiplied by a gain 
amount of about 6 dB. 

9. A method according to claim 8, wherein the FIR 
filters correspond to four different angles of incidence 
including 90°, 120°, 240° and 270°, and wherein the 
delay for the 90" filter is 15 ms, the delay for the 270° 
filter is for 20 ms, the delay for the 120° filter is 25 ms 
and the delay for the 240° filter is 30 ms. 

10. A method according to claim 8, wherein the FIR 
filters correspond to four different angles of incidence 
including 90% 120% 240° and 270°, and wherein the 
delay for the 90* filter is 15 ms, the delay for the 270" 
filter is for 25 ms, the delay for the 120* filter is 35 ms 
and the delay for the 240* filter is 45 ms. 

11. A method according to claim 8, wherein the FIR 
filters correspond to four different angles of incidence 
including 90', 120% 240* and 270*, and wherein the 
delay for the 90* filter is 25 ms f the delay for the 270° 
filter is for 30 ms, the delay for the 120* filter is 35 ms 
and the delay for the 240° filter is 40 ms. 

12. A method according to claim 8, wherein the FIR 
filters correspond to four different angles of incidence 
including 90% 120% 240° and 270% and wherein the 
delay for the 90* filter is 25 ms, the delay for the 270° 
filter is for 35 ms, the delay for the 120° filter is 45 ms 
and the delay for the 240* filter is 55 ms. 
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